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(54) Color reproduction terminal apparatus, network color reproduction system, and color 
reproduction method 



(57) A color reproduction system accurately cor- 
rects color displayed on a user's own display by gener- 
ating a profile at a server, in order to allow each user to 
obtain a service for performing accurate color reproduc- 
tion through a network. This system includes a network 
connecting section (107) for connecting a color repro- 
duction terminal apparatus to a network; a color image 
display (105) for displaying a color image; a color cam- 
era (101) or a sensor (102) for capturing a color repro- 

Fig. 1 



duction characteristic of the color image display and a 
viewing illuminant condition; and a color converting sec- 
tion that provides color conversion for the color image 
obtained through the network and outputs it to the color 
image display. The color conversion may be provided for 
a color image obtained though the network using a color 
conversion profile and a color conversion program 
which are downloaded through the network. 
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Description 

BACKGROUND OF THE INVENTION 

5 FIELD OF THE INVENTION 

[0001 ] The present invention relates to color management and correction technology employing a color display ter- 
minal and a network color reproduction system using the terminal. 

w DECRIPTION OF THE RELATED ART 

[0002] Recently, in the field of a color management technology, a software system for color management has been 
installed in an operating system (OS) level for providing color matching between color devices such as scanners, dis- 
plays, and printers. In this color management system (hereinafter referred to as CMS), device color conversion charac- 

15 teristic information called a color conversion profile is prepared in advance for each color device, and is installed as a 
color converting part in an OS of a personal computer (PC). The color converting part converts a color value to a device 
value by performing the color conversion of a color image based on the color conversion profile. Measurement of such 
display characteristic and modeling of the device are hereinafter called "characterizations". The color conversion profile 
of a color device is produced based on a measurement result of the color device and a calculation algorithm by a color 

20 device manufacturer. The color conversion profile is provided to a user together with the color device when the user pur- 
chases the color device. 

[0003] At the present time : the color management can be practically and effectively operated only in a very narrow 
field for of the following reasons. 

[0004] Firstly, a color device and an apparatus using it generally have their individual difference and aging variation. 
25 When the color device is intended to be characterized, accuracy of color reproduction is still low even using a typical 
color conversion profile provided by the manufacturer. In addition, color reproduction characteristic of a color display is 
greatly affected by characteristics of not only the display itself but also a display card built in a PC. The user is therefore 
required to perform the characterization of his/her color device by himself/herself. 

[0005] Fig. 20 shows a characterization method or a calibration method of a display in accordance with the prior 
30 art. Colorimeter 2001 is adsorbed to display 2005, reads a color signal, and feeds color signal data into PC 2004 via 
measuring equipment interface 2002 and cable 2003. The PC generates a display profile or finely adjusts the profile in 
relation to secular changes by software. For this adjustment, however, an originally unnecessary measuring equipment 
is required, and the display must be measured before every usage thereof. This is troublesome for common users, and 
is not practical. 

35 [0006] Secondly, not all PCs support color management. Recently-developed PCs may perform the color manage- 
ment at an OS level, but many PCs, among an unspecified number of those linked to a network, have an OS that does 
not support the color management itself These PCs cannot perform the color management itself. 
[0007] Thirdly, there is a problem of cross media color reproduction, which has recently become especially contro- 
versial. In other words, color reproduction under different illuminant conditions or between different types of media such 

40 as a display and a printer cannot be achieved in a conventional colorimetric color reproduction method. Color appear- 
ance on a display varies under different illuminations, because different illuminations have different effects on the color 
appearance. A color conversion method in this case has not been developed. 

SUMMARY OF THE INVENTION J 

45 . . 

[0008] A color reproduction terminal apparatus in accordance with the present invention includes a color camera 
with a known characteristic, always or adequately captures images on a display surface using the camera from a 
remote position, and measures a color reproduction characteristic of the display. In addition, the terminal apparatus 
automatically generates a display profile optimized for a user's own color display. In an application such as an interac- 

50 tive television (TV) meeting or a remote medical system, the display and the color camera are normally placed on the 
user side, and therefore, installation of an additional color camera as a new apparatus is not required. 
[0009] A display measurement method defined by International Electrotechnical Commission (IEC) /TC100 orthe 
like describes the measurement from a spaced position at a certain distance from a display, especially in relation to a 
liquid crystal display (LCD). The color reproduction terminal apparatus in the present invention can also be used fir such 

55 measurement. A profile-generating part is placed not in a user terminal but in a color reproduction server on a network 
in order to improve flexibility of an algorithm. The user terminal downloads, from the color reproduction server, charac- 
teristic data of the color camera and color patch data used for the measurement of the display. Then, the user terminal 
measures the display characteristic and transmits a measurement result to the color reproduction server. The color 
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reproduction server generates the user's display profile based on this measurement result, and therefore, the user ter- 
minal can automatically download a color conversion profile optimized for his/her own display. 

[0010] In a network color reproduction system provided in the present invention, the color reproduction server 
stores a color conversion program executable at the user terminal. The user terminal automatically downloads this pro- 
5 gram and performs the color management. This is performed by a World Wide Web (WWW) browser and JAVA applet 
in the present Internet. 

[001 1 ] A color reproduction terminal provided in the present invention includes a simple illuminant light sensor. This 
sensor captures ambient illumination during image-capturing by the color camera at the terminal and during viewing the 
display. Based on the obtained illuminant light information, a colorimetric value indicated at the user terminal is cor- 
10 rected. In this way, the reproduced color on the display is accurately corrected under various environments such as in 
a darkroom, in a general room, or out of doors. 

[0012] In the color reproduction method In the color reproduction system in accordance with the present invention, 
conventional XY2 values (tristimulus values) are matched, and additionally, matching in the color appearances and 
matching in spectral distributions are effected. 

15 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0013] 

Fig. 1 is a block diagram of a color reproduction terminal apparatus in accordance with a first exemplary embodi- 
ment of the present invention. 

Fig. 2 is an external view of the color reproduction terminal apparatus in accordance with the first exemplary 
embodiment. 

Fig. 3 shows three types of setting methods of a camera head in the color reproduction terminal apparatus. 
Fig. 4 is an external view of a color reproduction terminal apparatus using a projector. 
Fig. 5 shows an operation of a color reproduction terminal apparatus that supports color management. 
Fig. 6 shows an operation of a color reproduction terminal apparatus that does not support color management. 
Fig. 7 is a block diagram of a network color reproduction system in accordance with the first exemplary embodi- 
ment. 

Fig. 8 is a flowchart for generating a display profile in accordance with the first exemplary embodiment. 
Fig. 9 is a block diagram of a color reproduction terminal apparatus in accordance with a second exemplary embod- 
iment. 

Fig. 10 is an external view drawing of the color reproduction terminal apparatus in accordance with the second 
exemplary embodiment. 

Fig. 1 1 is a block diagram of a network color reproduction system used for network shopping in accordance with 
the third exemplary embodiment. 

Fig. 1 2 is a flowchart for an operation of the network color reproduction system used for network shopping. 
Fig. 1 3 is a flowchart for a correcting process of illumination, chromatic adaptation, and contrast.- 
Fig. 14 is a flowchart for a correcting process of illumination, chromatic adaptation, and contrast of a color repro- 
duction terminal apparatus in accordance with a fourth exemplary embodiment. 

Fig. 15 is a block diagram of a network color reproduction system used for network shopping in accordance with a 
fifth exemplary embodiment. 

Fig. 16 is a flowchart for an operation of the network color reproduction system used for network shopping in 
accordance with the fifth exemplary embodiment. ' 
Fig. 1 7 shows a multi-dimensional primary color conversion process in the network color reproduction system. 
Fig. 1 8 is a block diagram of a network color reproduction system used for a remote medical care service in accord- 
ance with a sixth exemplary embodiment. 

Fig. 19 is a flowchart for an operation of the network color reproduction system used for the remote medical care 
service. 

Fig. 20 shows a conventional color reproduction terminal apparatus. 
DESCRIPTION OF THE PRERERRED EMBODIMENT 
(Preferred embodiment 1) 

55 

[0014] Fig. 1 illustrates a structure of a color reproduction terminal apparatus in accordance with embodiment 1 . 
[0015] The color reproduction terminal apparatus in Fig. 1 has a function for accurately displaying a color image 
downloaded through a network on a color display. This terminal apparatus is constituted with CPU 106, network inter- 
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face 107, memory 108, hard disk 109, color display/projector 105, color camera 101 , illuminant light sensor 102, input 
unit 110, and output unit 1 11. 

[0016] Color camera 101 is used for capturing interactive picture images or screen images in a remote medical care 
service or a TV meeting, and for measuring a screen of display 1 05 for color management. Illuminant light sensor 1 02 
5 obtains image-capturing environment information of color camera 101 for the color management and Illuminant infor- 
mation under a viewing environment where display/projector 1 05 is placed. Some of such computer systems have an 
OS having built-in CMS, and others have an OS having no built-in CMS. The present invention considers both cases, 
and does not impose a specific restriction. 

[0017] This terminal apparatus, for measuring a screen of a user display, employs not a special sensor but an inex- 
10 pensive and simple color camera which is usually used for a TV meeting. Color indicated on the display can be meas- 
ured from a position near an observer's point of view, by designing a support and a camera bead of the color camera 
to make a direction and a position of the color camera changeable. 

[0018] Fig. 2 is a perspective view of the color reproduction terminal apparatus in accordance with this embodi- 
ment. Color camera 203 is supported by a camera arm 204. Camera arm 204 is movably connected with a display table 

15 2C5, and a camera head can be also freely rotated. In this mechanism, color camera 203 is fixed to a position arbitrary 
in relation to display screen 202. Fig. 2 illustrates just a concept, and various actual mechanisms, in addition to this 
example, are within the scope of the present invention. A signal from color camera 203 is fed into a computer system 
20 ; tnrough display table 205, though this is not shown in Fig. 2. This signal is an analog or digital video signal. Illumi- 
nant light sensor 206 is used for obtaining viewing illuminant information of display screen 202 and color camera 203. 

20 Color camera 203 with a filter attached to its lens and an additional signal processor can be used in place of illuminant 
light sensor 206. 

[0019] Fig. 3 shows setting examples of color camera 203 in three types of operations of the color reproduction ter- 
minal apparatus in accordance with this embodiment. 

[0020] In example 301 in Fig. 3, a color reproduction characteristic of display 202 is measured for characterization 
25 or calibration of display 202. Color camera 203, which is directed to a screen of display 202, captures displayed color 
or color patch 302, and the captures signal is taken into computer 201. At this time, usually, illumination in a room is 
preferably set under a darkroom state. Color camera 203 is preferably set facing the screen of display 202, and is 
spaced by a distance usually selected by a user, and camera arm 204 has a freedom applicable to it. 
[0021] Example 310 shows a setting of the color reproduction terminal apparatus of this embodiment in an applica- 
nt? tion in which a color image is displayed and observed on display 202 through a network, such as in network shopping 
or an electronic museum. In this case, color camera 203 is not required, and is folded so that it does not disturb the 
viewing over the front of the display. Color camera 203 may always capture the display screen to perform color man- 
agement of display 202. 

[0022] In example 320, an application to a remote medical care service or a TV meeting is assumed. Because static 
35 or dynamic images formed by capturing an image of the face of user 322 with color camera 203 are transmitted 
between a plurality of users, the head of color camera 203 is rotated and set at a position for capturing the image of the 
face of user 322. 

[0023] In Fig. 3, a cathode ray tube (CRT) or LCD is used as the display. On the other hand, Fig. 4 shows a state 
where a projector is used. This apparatus comprises projector 401 used instead of the CRT or LCD display, and a 
40 screen 402. Reference numeral 404 denotes a camera head directed to the screen and to enable colorimetry of pro- 
jected color image .403. Reference numeral 405 denotes a camera head photographing user 322. Hereinafter, the dis- 
play includes the projector. 

[0024] Fig. 5 is a schematic diagram of a process of CMS in a color reproduction terminal apparatus of embodiment 
1. In many present computers, CMS is embedded in the OS. Variation of reproduced colors caused by difference of 

45 applications can be eliminated by the CMS of embodiment 1 . 

[0025] The CMS is constituted with color conversion part 506, i.e. a software module for performing a color conver- 
sion process of a color image, and color conversion profile 504, i.e., a color reproduction characteristic file of a color 
device such as a display included in color conversion part 506. Color conversion profile 504 is supplied by a manufac- 
turer that produces a color device such as a color camera or a color display. In the CMS, a color oonversion profile of a 

so source-side color device converts a device-dependent color space of the color image to a device-independent color 
space, and then a color conversion profile of a destination-side color device converts the device-independent color 
space to a device-dependent color space. 

[0026] For example, when a color image through the internet is observed by a user's display, the color image 
through the Internet is mostly represented in a standard red-green-blue (sRGB) color space. Color image 502 sent 
55 through Internet 501 is converted to an XYZ color space with sRGB profile 503, and is converted from the XYZ color 
space to an RGB color space with user's color conversion profile 504 in color conversion part 506 on a user PC. Then, 
the image is displayed on display 508 at a correct RGB value. 

[0027] Such a method that XYZ color space is matched to perform color reproduction is executed in a relatively sim- 
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pie system, and is frequently used. But it is hardly said that this method is really accurate. This is based on the following 
facts. 

(1) Color displacement is caused even when displaying a color of the same XYZ value is intended, because maxi- 
5 mum luminance or color range capable of being tapped-off varies for each display and color range mapping is per- 
formed. 

(2) Color reproduction by the method where the XYZ value is matched is allowed only when the same type of media 
are observed under the same illumination, but is not allowed when illumination varies or an actual object is visually 
compared with an image on the display. In particular, a color appearance model has been studied and standardized 

w as "color reproduction between cross media," and an algorithm relating thereto has been developed. 

[0028] For performing higher accuracy color reproduction while considering the facts mentioned above, the color 
reproduction terminal apparatus of this embodiment includes a sensor for measuring illumination in an environment 
where the user display is placed. In this apparatus, the color conversion profile generated from values measured by this 
id sensor and the color conversion part for carrying out the actual color reproduction using this color conversion profile are 
constituted as a stationary module. In addition, in anticipation that research study results of color appearance models 
will be hereinafter sequentially standardized, the apparatus has a constitution where a color conversion software mod- 
ule is downloaded from an individual color reproduction server placed on the network. 

[0029] Fig. 5 and Fig. 6 show a software structure in the color reproduction terminal apparatus in accordance with 
20 the present invention. Fig. 5 shows the apparatus in which the CMS is embedded in the OS of the color reproduction 
terminal, and Fig. 6 shows the apparatus in which the CMS is not embedded. In Fig. 6, it is assumed that the color con- 
version software module is downloaded. from network 601 to color conversion part 604. The CMS function is realized 
not at the OS level but at application level 606 such as a network browser. 

[0030] Fig. 7 shows a structure of a network color reproduction system in accordance with this embodiment. Color 
25 reproduction terminal apparatus 705 as a user terminal and color reproduction server 706 are placed on network 707. 
In server 706, the following elements are stored: 

(a) color patch data 701 ; 

(b) camera profile database 702 for storing a color conversion profile of a camera in the user terminal; 
30 (c) profile generating program 703 for generating a display profile of the user terminal; and 

(d) color conversion part program 704 that is downloaded to the user terminal and is used to perform color conver- 
sion. 

These elements are required for performing characterization of the display of terminal apparatus 705. 

35 [0031] Color patch data 701 comprises tens of color patched data represented by RGB data, and is used to meas- 
ure the color reproduction characteristic of the display. Camera profile database 702 is produced for each product basi- 
cally by a camera manufacturer. A user can download an image-capturing characteristic of a camera through network 
707, based on information such as a model of the camera actually used in color reproduction terminal apparatus 705 
on the user terminal side. Profile generating program 703 is a program for generating the display profile discussed 

40 below. Color conversion part program 704 is a module for performing color conversion not on color reproduction server 
706, but on terminal apparatus 705 after being sent into terminal apparatus 705 on the user terminal side. 
[0032] A procedure is described for carrying out the color reproduction using this network color reproduction sys 1 
tern. The user must initially calibrate a device of his/her own color reproduction terminal apparatus 705. In this embod- 
iment, this calibration is performed as follows: ' 

45 

(1 ) capturing display screen 202 with color camera 203 attached to user terminal 705; 

(2) sending captured data to color reproduction server 706, and causing the server to generate the display profile; 
and 

(3) downloading this profile to user terminal 705. 

50 

Fig. 8 shows this procedure. 

[0033] At step 801, color patch data 701 having a plurality of colors is transmitted from color reproduction server 
70G in the RGB data form in response to a request of color reproduction terminal apparatus 705. At step S02 terminal 
apparatus 705 obtains color patch data 701 through network 707, and at step 803 terminal apparatus 705 displays color 
55 patch data 701 on display 202. 

[0034] In terminal apparatus 705, at step 804, the user sets camera 203 at a position indicated in example 301 in 
Fig. 3, and captures a color patch image on display 202 using camera 203. The captured color patch image is obtained 
as RGB data, after a process for reducing data amount such as a calculation of an average value of a plurality of rep- 
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resentative picture elements of each color patch from the image. This RGB data value is derived by reading the color 
patch data with the camera, is different from the original RGB data value of the color patch (obtained at step 802), and 
is affected by a color development characteristic of display 202 and an image-capturing characteristic of camera 203. 
[0035] At step 805 and step 806, the RGB data of the image captured color patch is sent out to color reproduction 
5 server 706. At step 807, camera information such as the model number of camera 203 used for capturing the image of 
color patch data 701 is sent out from terminal apparatus 705 to color reproduction server 706. 

[0036] At step 808, server 706 searches camera profile database 702 based on the obtained camera information 
to select a camera profile. At step 809 and step 810, terminal apparatus 705 obtains the selected profile. The camera 
information, more specifically, means the product number of the camera being used and the like.. An aging variation or 
w individual difference for the same model in relation to characteristics of a CCD .or a color filter of the camera is consid- 
ered to be relatively small. 

[0037] At step 81 1 , server 706 converts the RGB data of color patch data 701 to XYZ data with the camera profile. 
At step 812, server 706 derives a display profile of terminal apparatus 705 from the XYZ data. Because color indicated 
by this XYZ data is color-reproduced when display 202 develops color of color patch data 701, a color reproduction 
15 characteristic of display 202 can be calculated if an image-capturing characteristic of camera 203 is available. 

[0038] At step 813, the display profile calculated by server 706 is sent to terminal apparatus 705, and terminal 
apparatus 705 obtains its own display profile. 

[0039] As discussed above, in this embodiment, because a display profile generating algorithm is placed on a color 
reproduction server outside the user terminal, it can be arbitrarily upgraded and is variously advantageous for the user. 
20 These procedures are written in a program executable by a computer, are stored in a hard disk or a portable storage 
medium, and axe executed in terminal apparatus 705 and server 706. 

(Preferred embodiment 2) 

25 [0040] Fig. 9 illustrates a structure of a color reproduction terminal apparatus in accordance with embodiment 2. 
The Fig. 9 apparatus differs from a structure in Fig. 1 in embodiment 1 in that the structure in Fig. 9 has person image- 
capturing camera 901 and display capturing camera 902. As shown in Fig. 10, person image-capturing camera 1001 
captures the image of the user's face on the color reproduction terminal apparatus, and display capturing camera 1002 
always or intermittently captures color patch region 1 003 on display 202. 

30 [0041] In this structure, one additional camera is required. However, in an interactive application between users 
such as a remote medical care service discussed below, the CMS in the color reproduction terminal apparatus always 
operates, and can correspond to time-dependent variation of light in a viewing environment. 

[0042] The flowchart shown in Fig. 8 is applied also in this embodiment, but the process in Fig. 8 is always per- 
formed at a certain interval differently from embodiment 1 , 

35 

(Preferred embodiment 3) 

[0043] Fig. 1 1 shows a structure of a network color reproduction system in an application where network shopping 
on a network is assumed. A purpose of this system is to reproduce a color image of a commodity, i.e., contents of the 
40 network shopping, with correct color on a color reproduction terminal apparatus on a user terminal side. Here, the cor- 
rect color is defined as the color which appears when the commodity is actually placed in a user's environment. There- 
fore, in the color reproduction terminal apparatus, processes such as illumination and chromatic adaptation corrections 
are required. . 

[0044] In the network color reproduction system in Fig. 1 1 , the network 70$ is connected with the following ele- 
45 ments: 

(1) color reproduction terminal apparatus 705 on the user side; 

(2) color reproduction server 706; and 

(3) image server 1 101 for network shopping for providing contents image data 1102 for network shopping and 
so image-capturing illuminant information 1104. The image-capturing illuminant information means one of spectral 

distribution information Es(X) and chromaticity information (Xs, Ys, Zs) of illumination when the image of the com- 
modity of the network shopping is captured.. Color reproduction server 706 stores color conversion part program 
704 and sRGB profile 1103, and sends them to terminal apparatus 705. Terminal apparatus 705 performs color 
conversion. 

55 

[0045] The sRGB profile is a file in which a conversion characteristic between an sRGB color space and an XYZ 
color space is described, is generated with a fixed calculation equation, and therefore, is independent of different appa- 
ratuses. This sRGB profile is not required to be in the color reproduction server and may be in the user terminal side. 
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Here, color specification of each color image on the server is defined as that on the sRGB color space that is virtually 
a standard in the present network world. 

[0046] In the illustration of this embodiment, it is assumed that terminal apparatus 705 obtains a user display profile 
in advance due to the function of color reproduction server 706 in the processes shown by Fig. 7 and Fig. 8. 
[0047] Fig. 1 2 is a flowchart for the color conversion operation of the network color reproduction system for network 
shopping. 

[0048] At step 1201, image server 11 01 sends out image data written in the sRGBformto terminal apparatus 705 
in response to a request of terminal apparatus 705 on the user side. At step 1 202, terminal apparatus 705 receives the 
image data. 

o [0049] At step 1 203 and step 1 204, terminal apparatus 705 obtains a color conversion part (a color conversion soft- 
ware module) from color reproduction server 706. This color conversion part is a program module executed by terminal 
apparatus 705. At step 1205 and step 1206, terminal apparatus 705 obtains an sRGB profile from color reproduction 
server 706. 

[0050] At step 1207, the color conversion part of terminal apparatus 705 converts the image data from the sRGB 
5 form to the XYZ form using the sRGB profile. 

[0051] At step 1208, image server 1 101 sends out image-capturing illuminant information A1 104 to terminal appa- 
ratus 705. Terminal apparatus 705 receives information A1 104 at step 1209. At step 1210, illuminant light sensor 206 
on terminal apparatus 705 obtains viewing illuminant information B1 1 05, representing the illumination under which the 
user observes the image. 

20 [0052] At step 121 1, terminal apparatus 705 corrects illumination, chromatic adaptation, and contrast of the XYZ 
value, namely, the image data, based on image-capturing illuminant information A1 1 04 and viewing illuminant informa- 
tion B1 105. This correction compensates conventional CMS inadequacy where color appearance varies depending on 
illumination or chromaticity of white, and matches the XYZ value to the color appearance. 

[0053] Terminal apparatus 705, at step 1212, converts the corrected XYZ value in relation to the illumination to an 
25 RGB value, i.e. a display device value with the already obtained own display profile (step 813 of Fig. 8), and, at step 
1213, displays the color image on the display. 

[0054] Fig. 13 and Fig. 14 illustrate details of illumination, chromatic adaptation, and contrast corrections at step 
121 1 . In Fig. 13, (XA, YA, ZA) are tristimulus values XYZ when the image data is captured at step 1207 in Fig. 12. Illu- 
mination under which this image a captured is set as image-capturing illuminant information A. At step 1302, (XA, YA, 
so ZA) are converted to cone response values (L, M, S) by a Hunt- Pointer- Estevez transformation (for example, refer to 
Naoya Katoh: "Practical Method for Appearance Match between Soft Copy and Hard Copy," SPIE Vol. 2170, 1994). 
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[0055] At step 1303 a chromatic adaptation conversion from image-capturing illuminant information A to viewing 
illuminant information B is performed, and at step 1304, the converted values (U M' S') are obtained. At step 1305, (U 
M' S') are again converted to the XYZ form to obtain (XB, YB, ZB) under illumination B. These conversions are per- 
formed at a time in the following equation responsive to the Von-Kries rule. ' 
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(2) 



performed simultaneously in equation (2) response to the Von-Kries rule. In equation (2), LmaxA and LmaxB are max- 
imum values of L under respective environments of illuminant information A and illuminant information B. Similarly, 
MmaxA and MmaxB are maximum values of M, and SmaxA and SmaxB are maximum values of S. 
55 [0056] Then, at step 1 306 ; contrast conversion is carried out. This corrects a phenomenon that an apparent gamma 
value varies under variation of illumination. 

XB* = xe 7 ( 3 ) 
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YB l = YB y 



ZB' = ZB ( 

5 

[0057] At step 1 307, (XB' YB' ZB') derived after the contrast conversion are output. 

[0058] In the procedures discussed above, the same color appearance as that of the captured contents is repro- 
duced on the terminal apparatus. The method shown here is written as a program executable by the computer, is stored 
in storage media, and is executed at color reproduction server 706, server 1 101, and terminal apparatus 705. 

w 

(Preferred embodiment 4) 

[0059] Fig. 14 is a flowchart for a correcting process of illumination, chromatic adaptation, and contrast of a color 
reproduction terminal apparatus in an application such as network shopping in accordance with embodiment 4. This 
15 embodiment is different front embodiment 3 in illumination, chromatic adaptation, and contrast corrections shown at 
step 121 1 in Fig. 12. The different part is illustrated in the drawing and discussed below. 

[0060] In embodiment 4, illuminant light sensor 206 of the color reproduction terminal apparatus on a user terminal 
side can measure spectral distribution of illumination. The system in embodiment 3 corrects the XYZ values by deriving 
the cone response LMS values from the derived XYZ values, estimating the chromatic adaptation using the Von-Kries 
20 rule, and performing contrast conversion. This is a method for matching color appearance mainly using a human-visual- 
sense-characteristic, and is called color appearance matching. In embodiment 4, spectral distribution of an object is 
estimated and tristimulus values are reproduced under viewing illumination. 

[0061] The correcting process of illumination, chromatic adaptation, and contrast is illustrated in detail in Fig. 14. 
[0062] Processes at step 1401 are hereinafter described. Tristimulus values (XA, YA, ZA) calculated in relation to 
25 image-capturing illuminant condition A (Es(X)) are represented by the following integration, where f(A,) is object spectral 
distribution. 

XA = \x(X)Es(X)f(X)dX (4) 
3 o YA = ly{X)Es(X)f(X)dX 

ZA = iz(X)Es(X)f(X)dX 

[0063] In equation (4), an infinite-dimensional quantity 1(X) is converted to a 3-dimensional quantity with integration. 
35 For estimating the infinite-dimensional quantity f{X), this equation must be solved inversely. Two solution methods are 
available. 

[0064] In a first method, the infinite-dimensional quantity f{X) is considered as a P-dimensional vector, and a P- 
dimensional quantity is directly estimated from the three-dimensional quantity. At first, the equation is written in a dis- 
crete form and is represented as a matrix. The integration is performed in a visible wavelength range, i.e., X is between 
40 3 80 nm and 780 nm. Representing all functions of A, as a P-dimensional vector, equation (4) becomes equation (5). 

X-Tf (5) 

y 

45 

where, 
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X = (XA YA ZA)' 



(6) 



T- 



z 1 £j l z 2 £y 2 - z r Esp 



20 



and 3 x P matrix T is a known matrix generated from discrete forms Xj, yj, Zj of color matching functions x(X), y(X), and 
z(9i), and image-capturing illumination Esj. Therefore, the unknown vectorf must be solved from viewing quantity vector 
X and 3 x p matrix T, but cannot be accurately solved because dimension P of the unknown vector f is higher than 
dimension 3 of vector X. Estimated vector f is written by 



CD 



25 



as a pseudo inverse matrix solution, or 



f - E{t ryv(jE{t t}Ty l x 



(8) 



30 



35 



as a Wiener estimation solution. 

In the Wiener estimation solution, self-correlation matrix E(ti x ) is provided from information provided in advance. 
[0065] In a second method, infinite-dimensional quantity f(A) is estimated by assuming that f(X) is developed and 
represented as a sum of products of known R-dimensional bases ej (X) and weight coefficients aj by a principal compo- 
nent analysis of f(A,) or the like. 



(9) 



This equation is written by 



45 



(10) 



ea 
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in matrix representation, where, 
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f-(/x fx 

a = (a 1 c 



e - 



el el 



e 1 e 2 



(ii) 



25 



where 



is the i-th component of the j-th base vector e' {X) in discrete representation. Substituting equation (1 0) for equation (5), 



X-Tea-Ua 



(12) 



is derived, using 3 x R matrix U, namely, the product of 3 x P matrix T and P x R matrix e. Estimation of vector a from 
this equation involves estimation of an R-dimensional vector from a 3-dimensional vector. If R is in a range of 4 or 5, 
this method is sufficiently practical, and is more accurate than the first method. The estimation method is similar to that 
30 of the first method. As a pseudo inverse matrix solution, 



35 



a-irruu'r'x 



is derived, or as a Wiener estimation solution, 



(13) 



40 



a =£{aa f }U'(UE{aa'}U f ) -1 X 



(14) 



is derived. After vector a is derived, vector f is derived wfth equation (9). Processes at step 1401 finish here. 
45 [0066] After object spectral distribution vector f, i.e., infinite-dimensional quantity f(X) is estimated, at step 1402, 
viewing illuminant information B (E Q (X)) is obtained from illuminant light sensor 206, and tristimulus values (XA\ YA', 
ZA 1 ) under viewing illumination are calculated by integration of f(A.) and E 0 (X). 



50 



XA'zz \x(\)Eo(\)f(X)d\ 
YA ' - \y(X)Eo(X)f(X)dX 
ZA'= iz(X)Eo(X)f{X)dX 



(15) 



55 (Preferred embodiment 5) 



[0067] Fig. 1 5 shows a structure of a network color reproduction system in an application such as network shopping 
in accordance with embodiment 5 of the present invention. 
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[0068] The system in accordance with this embodiment estimates spectral distribution of an object image, and per- 
forms color reproduction for reproducing it with a multi-primary-color projector or a multi-primary-color display at an out- 
put terminal Multi-color color reproduction has two advantages. As a first advantage, spectral color reproduction is 
easier comparing with the reproduction where only tristimulus values XYZ are matched. When the spectral color repro- 
5 duction can be realized, a conventional problem, i. e., that color appearance varies depending on illumination even if 
the same XYZ values are employed, is resolved. As a second advantage, a larger color gamut than that achieved by 
three-primary-color reproduction can be realized. 

[0069] The network color reproduction system in the network shopping as shown in Fig. 1 5 is constituted with color 
reproduction server"706, image server 1101 for network shopping, and color reproduction terminal apparatus 1506. 

w Object spectral distribution estimating program 1501 is stored in color reproduction server 706. This program is sent 
from server 706 to terminal apparatus 1506 where it is operated. If this program is operated on server 706, a huge 
amount of spectral characteristic image data must be transferred to terminal apparatus 1506 through network 707. To 
avoid this, this system operates this program in the terminal apparatus. Image data 1102, i.e., contents, are stored in 
image server 1 1 01 . The stored form of image data 1 1 02 is N-band color image captured by a normal color camera or 

75 a multi-spectral camera in this embodiment. When N=3, this is an RGB image captured by a usual color camera. In 
addition, the stored form can also be spectral distribution data or compressed spectral data. 

[0070] the spectral distribution of a natural matter, i.e., an object, is generally infinite dimensional, but is assumed 
discretely as M-dimensional data (M > N). This M-dimensional data is about 1 00-dimensional data sampled from a nor- 
mal visible range, namely, about a 400 nm spectral range between 380 nm and 780 nm, every 4nm. Actual spectral dis- 
20 tribution, however, has a degree of freedom not so high as 100, and usually, can be sufficiently represented by a 
relatively small number of base vectors. 

[007i] image server 1 101. stores the following information: 

(1) object spectral distribution base information 1503, namely, R base vectors sampled every specific image in a 
25 principal component analysis based on the analysis of images stored as the contents; 

(2) image-capturing illuminant spectral information 1504 when a content's image is captured; and 

(3) filter information 1 505 of the color camera with which the contents image are captured. 

Terminal apparatus 1506 has a projector where a number of primary colors can be easily extended over three, and this 

30 projector is observed in a darkroom. 

[0072] Fig. 1 6 illustrates an operation of a network color reproduction system in accordance with this embodiment. 
At step 1601 and step 1602, terminal apparatus 1506 receives image data 1 102 from image server 1 101 responsive to 
a request of terminal apparatus 1506. At step 1 603 f terminal apparatus 1506 obtains camera filter characteristic infor- 
mation of the. camera that captures image data 1 1 02 from image server 1101, and image-captured illuminant spectral 

35 information during capturing. At step 1604, terminal apparatus 1506 obtains spectral distribution base information 
1503, namely, R base vectors of the spectral distribution of an object included in image data 1 102. 
[0073] Then, at step 1 605, color reproduction server 706 sends out object spectral distribution estimating program 
1501 to terminal apparatus 1506. At step 1606, spectral distribution of image data 1 1 02 is estimated. The estimation is 
achieved by estimating R weight coefficients a s in relation to R bases based on an N-band color signal. The estimation 

40 without using any base vector generally has poor accuracy because it is a considerably difficult work in which variables 
of P-dimensional spectral data (about 50 dimensions) must be estimated from N bands. Employing the base vectors 
improves estimation accuracy. In this estimation method, a pseudo inverse matrix solution or a Wiener estimation solu- 
tion can be used. Then, the k-th sensor output g k of the N bands can b ft e represented as follows, using sensor spectra! 
characteristic S k (?l), illumination Es(A.) f and object spectral. reflectance^*). 

45 

g k = \S k (X)Es(X)f(\)d\ (16) 

[0074] Assuming that f(A.) is developed on R bases as equation (9) due to its statistical property, equation (16) is 
written as 

50 

R 

9k = y £a l \S k (X)Es(X)e i (X)dX (17) 

55 

Writing this in a discrete form and representing this as a matrix, 
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where, 



T- 



S 2l Es J 



)' 



(19) 



S»Es P 
S zjr Es l . 
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35 



40 



[0075] Because the form of equation (18) is finally the same as that of equation (12), vector a is estimated and f(X) 
is derived using the pseudo inverse matrix solution or the Wiener estimation solution, as shown in equation (13) and 
equation (14). ' 

[0076] At step 1609, multi-primary-color conversion is performed for reproducing the derived spectral distribution 
as it is. This conversion is required in a general case that the number of dimensions of the derived base vector is differ- 
ent from the number of primary colors finally reproduced. At step 1 61 0, data derived by the multi-primary-color conver- 
sion is displayed on a multi-primary-color projector. 

[0077] Now, Fig. 17 will be discussed, shows two process systems in the multi-primary-color conversion process 
shown at step 16G9. 

[0078] Process system 1 intends spectral color reproduction as a color reproduction target. Based on estimated P- 
band (dimensional) spectral distribution data 1700 of a color image, reproduction target spectral distribution 1701 is 
derived considering viewing illuminant condition 1703. At step 1702, color, conversion 1702 is performed for converting 
P-band primary colors to Q primary colors, namely, P-dimension to Q-dimension, so as to obtain a spectral distribution 
as close to spectral distribution 1 701 as possible. 

[0079] If the viewing illuminant condition is inside of a darkroom, reproduction target spectral distribution 1701 is 
spectral distribution data 1700 itself of an object. Spectral distribution 1701 is reproduced using a spectral distribution 
of Q primary colors. An approximate value o? infinite-dimensional quantity f(X) is generated by using spectra! character- 
istic Lj(X) (1<=i<=Q) of Q primary colors and weight coefficients Wj. 
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f(X)=£w i L i (X) 



(20) 



Representing this in a matrix. 
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is derived, where 



(22) 



W 



A A 3 
4 4 



A 0 
4 
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30 



Using least square error J as an evaluation standard of vector f, 



dJ 



0 



(23) 



ax 

J-(f-f)'(f-f) 



is derived. Solving this, vector W can be calculated as the following pseudo inverse matrix. 



35 



(24) 



40 When spectral data vector f is represented by a sum of R-dimensional bases as shown in equation (9), conversion from 
P-dimension to Q-dimension is not required. Multi-primary-color conversion 1609 is more easily realized by performing 
conversion 1 707 from R-dimension to Q-dimension. In this case, vector W is represented, as shown below, using matrix 
e and vector a in equation (11). . 
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W-CL'Lr'L'ea 



(25) 



50 



55 



[0080] In process system 2, tristimulus values are matched although multi-primary-color reproduction is performed. 
Reproduction target XYZ value 1704 is calculated from estimated spectral distribution 1700 using the l.age-capturing 
iiiuminant condition and viewing iiiuminant condition 170G. The 3 -dimensional XYZ value is converted to Q primary 
color (Q>3). Target XYZ value 1704 is derived by multiplying spectral distribution by a color matching function and by 
integrating them, and is corrected wider an iiiuminant condition. This correction can be performed in either method 
shown in Fig. 13 or Fig. 14. The number of solutions of the conversion to Q primary color for generating the same XYZ 
value is infinite, but the solutions can be derived as shown below. For example, 
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X=(SL)W 



(26) 



is assumed, where vector X represents target tristimulus values, and matrix S is a matrix which represents color match- 
ing functions x{\), y(X), and z(X) in discrete form. 



70 



X = (X Y Z)' 



(27) 
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20 

As a pseudo inverse matrix solution of vector W, 

W - (SL/CCSLXSLyr'X 

25 



is derived. . 

As a Wiener estimation solution, 

30 

W - E{W W'}(SL)'((SL)£{W W}(SL)T l X (29) 

35 

is derived, where, self-correlation matrix of vector W is provided in advance. 
(Preferred embodiment 6) 

^0 [0081] Fig. 18 shows a structure of a network color reproduction system applied to a remote medical care service 
system or a TV meeting system in accordance with embodiment 6. Images processed in this embodiment are moving 
images, which are generally different from those for network shopping. 

[0082] Color reproduction terminal apparatus A1801 on a user A side, color reproduction terminal apparatus B 
1 802 on a user B side, and co&r reproduction server 706 are placed on network 707. Color conversion part program 

45 704 is placed in server 706. Terminal apparatuses A1 801 , B1802 capture images of the faces of respective users, set- 
ting camera positions as shown in example 320 in Fig. 3. In the remote medical care service system, it is not required 
that both users see correct color, and color reproduction only on a doctor side is required to be accurate. A purpose of 
this system is to allow the user B to watch complexions or affected parts of opponents with accurate colors. 
[0083] As a precondition, as shown in embodiment 1 and embodiment 2, users A, B obtain a camera profile, a dis- 

50 play profile, a sRGB profile, and color conversion part program 704 from color reproduction server 706. 

[0084] In Fig. 19, at step 1900, illuminant light sensor 206 attached to color reproduction terminal apparatus A1801 
on the user A side obtains illuminant information A around terminal apparatus A1 801 . At step 1 901 , the image of user 
A is captured by a camera 203 io provide captured-image data A. At step 1902, color conversion pari program 704 tem- 
porarily converts captured-image data A into the XYZ form using the camera profile A, and then, at step 1 903, converts 

55 it to the sRGB form using the sRGB profile. At step 1 904, captured-image data A in the sRGB form and viewing illumi- 
nant information A are sent to network 707. 

[0085] Color reproduction terminal apparatus B1 802 on user B side obtains captured-image data A and viewing illu- 
minant information A at step 1905. At step 1 906, terminal apparatus B1 802 converts captured-image data A from the 
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sRGB form to the XYZ form using the sRGB profile of color conversion part program 704. At step 1 907, terminal appa- 
ratus B1802 converts captured-imageup data A(X Y Z) to captured-image data A(X' Y' Z') by correcting illumination, 
chromatic adaptation, and contrast using viewing illuminant information A. Terminal apparatus B1802 converts cap- 
tured-image data A(X' Y' Z') to the RGB form for display B using display profile B at step 1 908, and displays the image 
5 of user A on display B at step 1 909. The color of captured-image.data A on the user A side is accurately reproduced on 
terminal apparatus B1802. 

[0086] On the other hand, for sending captured-image data B of terminal apparatus B1802 to terminal apparatus 
A1 801 and reproducing its color, step 1900 to step 1 909 discussed above are repeated. 

[0087] !n detail, image-capturing illuminant information B around terminal apparatus B1802 is obtained at step 
w 1910, and user B is captured to provide captured-image data B at step 1911. Color conversion part program 704 con- 
verts captured-image data B to the XYZ form at step 1912, and converts it to the sRGB form at step 1 913. 
[0088] The converted sRGB captured-image data B and viewing illuminant information B are sent out onto the net- 
work at step 1914, and are received by terminal apparatus A1 801 at step 1915. The terminal apparatus A1 801 converts 
captured-image data B from the sRGB form to the XYZ form at step 1916, corrects captured-image data B(X Y Z) in 
15 relation to illumination, chromatic adaptation, and contrast at step 1 91 7, converts the corrected data to the RGB form 
for display A at step 1918, and displays this RGB data at step 1919. Thus, the complexion of user B is correctly repro- 
duced on the display A. 

[0089] By repeating the processes discussed above, mutual complexions can be interactively and correctly repro- 
duced on mutual displays, and thus network color reproduction is completed. 
20 [0090] Although, the present invention has been fully decsribed by the way of examples with reference to the 
accompanying drawings, it should be understood that numerous variations, modifications, and substitutions, as well as 
rearrangements and combinations, of the preceding illustrative embodiments will be apparent to those skilled. 
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Claims 

1 . A color reproduction terminal apparatus comprising: 



color image display means for displaying a color image; 

characteristic capturing means for capturing a color reproduction characteristic of said color image display 
30 means and a viewing illuminant condition, by employing at least one of a color camera and a sensor; and 

color conversion means for performing color conversion of a received color image obtained through a network 
using the color reproduction characteristic and the viewing illuminant condition to obtain a corrected color 
image, and for outputting the corrected color image to said color image display means. 

35 2. The color reproduction terminal apparatus according to claim 1, wherein said color conversion means performs 
color conversion to the color image using (i) at least one of a color conversion profile and a color conversion pro- 
gram which are downloaded through the network, (ii) the color reproduction characteristic, and (iii) the viewing illu- 
minant condition. 

40 3. The color reproduction terminal apparatus according to claim 1 , wherein: 

said characteristic capturing means includes the color camera and a sensor, 

the color camera includes at least one of a display capturing camera and a,person capturing camera, and 
the sensor includes an illuminant sensor. - _ ? 

4. The color reproduction terminal apparatus according to claim 1 , wherein said color image display means includes 
one of a liquid crystal display, a CRT display, and a projector. 

5. The color reproduction terminal apparatus according to claim 1 , wherein: 

said characteristic capturing means includes the color camera; and 
the color camera includes one of a digital still camera, a digital video camera, and a multi-spectral camera. 

6. The color reproduction terminal apparatus according to claim 1, wherein said characteristic capturing means 
55 includes a camera-head-position-moving-mechanism for moving the color camera so as to capture an operator and 

a display screen of said color image display means. 

7. The color reproduction terminal apparatus according to claim 1 , wherein: 
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said characteristic capturing means includes the color camera and the sensor, and 

the color camera and the sensor always or intermittently photograph at least a portion of a display screen of 
said color image display means. 

8. The color reproduction terminal apparatus according to claim 1 , wherein said color conversion means includes: 

means for estimating a spectral distribution of an object from a spectral characteristic of an image capturing 
camera and illuminant spectral information; and 

means for estimating tristimulus values of the object based on the viewing illuminant condition. 

9. The color reproduction terminal apparatus according to claim 1 , wherein said color conversion means further 
includes means for one of generating and updating a display profile of said color image display means from color 
patch data, a plurality of camera profiles, a profile generating program, and a color conversion program. 

15 10. The color reproduction terminal apparatus according to claim 2, wherein said color conversion means further 
includes means for downloading at least one of color patch data, a plurality of camera profiles, a profile generating 
program, and the color conversion program through the network, and said color conversion means further com- 
prises means for one of generating and updating a display profile of said color image display means. 

20 11. The color reproduction terminal apparatus according to claim 1 , wherein the color image is a moving image. 

12. A color reproduction server apparatus comprising: 



25 



means for storing a color conversion profile and a color conversion program; and 

means for supplying the color conversion profile and the color conversion program through a network to a color 
reproduction terminal apparatus in response to the request from the color reproduction terminal apparatus, 
whereby the color reproduction terminal apparatus is enabled to perform color conversion using the color con- 
version profile and the color conversion program. 

30 . 13. A network color reproduction system comprising: 

(a) a color reproduction terminal apparatus comprising: 
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45 



(a-1 ) color image display means for displaying a color image; 

(a-2) characteristic capturing means for capturing a color reproduction characteristic of said color image 
display means and a viewing illuminant condition by employing at least one of a color camera and a sen- 
sor; and 

(a-3) color conversion means for performing color conversion to a received color image obtained through 
a network using the color reproduction characteristic and the viewing illuminant condition to obtain a cor- 
rected color image, and for outputting the color image to said color image display means; and 

(b) a color reproduction server apparatus comprising: 

(b-1) r^eans for storing a color conversion profile and a color conversion program; and 
(b-2) means for supplying the color conversion profile and the color conversion program through the net- 
work to said color reproduction terminal apparatus in response to a request from said color reproduction 
terminal apparatus. 

14. The network color reproduction system according to claim 13, wherein: 

50 

(c) said color reproduction server apparatus further includes: 

(c-1) means for stonng at least one of a color patch data, a piuraiity of camera profiies, an sRGB profiie, a 
color conversion program, and a color conversion profile generating program; and 

(c-2) means for supplying at least one of the color patch data, the plurality of the camera profiles, the sRGB 
profile, the color conversion program, and the color conversion profile generating program through the net- 
work to said color reproduction terminal apparatus in response to a request from said color reproduction 
terminal apparatus; and 
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(d) said color reproduction terminal apparatus further includes 

(d-1) means for downloading at least one of the color patch data, the plurality of the camera profiles, the 
sRGB profile, the color conversion program, and the color conversion profile generating program through 
the network. 

15. The network color reproduction system according to claim 13 further including 

(e) an image server apparatus comprising: 

(e-1) means for storing image data; and 
(e-2) means for supplying the image data through the network to said color reproduction terminal appara- 
tus in response to a request from said color reproduction terminal apparatus. 

15 16. The network color reproduction system according to claim 15, wherein said image server apparatus further 
includes means for storing at least one of a multi -spectral color image comprising a plurality of bands, spectral dis- 
tribution information of image capturing illuminant, filter spectral characteristic information of a color camera used 
for capturing a image, and base vector information of spectral distribution of the color image. 

20 17. The network color reproduction system according to claim 13, wherein said color reproduction terminal apparatus 
further includes estimating means for estimating original spectral distribution from the received color image 
obtained through the network. 

18. The network color reproduction system according to claim 17, wherein said color reproduction terminal apparatus 
25 further includes means for downloading a program used in said estimating means from said color reproduction 

server apparatus through the network 

19. The network color reproduction system according to claim 13, wherein the color image is a moving image. 
30 20. A color reproduction terminal apparatus comprising: 

means for inputting a multi-spectral color image comprising P dimensions; 
means for determining a target spectral distribution to be reproduced; 

color conversion means for converting the target spectral distribution in a P-dimensional color space to a spec- 
35 tral distribution in a Q-dimensional color space; and 

means for outputting a color image based on the input color image in accordance with the spectral distribution 
in the Q-dimensional color space. 

21. A color reproduction terminal apparatus comprising: 

40 

means for inputting a multi-spectral color image comprising P dimensions; and 

color conversion means for converting the input color image to an R-dimensional vector using R base vectors 
for approximating spectra) distribution, where P is equal to or greater than R, and converting the R-dimensional 
vector to Q primary colors. »~ 



45 



22. A color reproduction terminal apparatus comprising: 



means for inputting a multi-spectral color image comprising P dimensions; 

means for determining a plurality of attributes of a color appearance model of a reproduction target with an illu- 
50 minant condition and a viewing illuminant condition; 

means for converting the attribute values to Q primary colors; and 

means for outputting a color image, based on the input color image, using the Q primary colors. 

23. The color reproduction terminal apparatus according to claim 20, 21. or 22, wherein the color image is a moving 
55 image. 

24. A color reproduction method comprising the steps of: 
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(a) downloading at least one of a color conversion profile and a color conversion program through a network: 

(b) capturing a color reproduction characteristic of a color image display and a viewing illuminant condition by 
employing at least one of a color camera and a sensor; 

(c) converting color of a color image obtained through the network using (i) at least one of the color conversion 
profile and the color conversion program, (ii) the color reproduction characteristic, and (iii) the viewing illumi- 
nant condition; and 

(d) outputting a color image converted in said step (c) of converting to color image display. 

25. A color reproduction method comprising the steps of: 
storing a color conversion profile and a color conversion program; and 

supplying the color conversion profile and the color conversion program to a color reproduction terminal appa- 
ratus through a network in response to a request from the color reproduction terminal apparatus, to enable the 
color reproduction terminal apparatus to perform color conversion using the color conversion profile and the 
color conversion program. 

26. A computer readable recording medium in which a program is recorded for making a computer execute a color con- 
version method using at least one of a color conversion profile and a color conversion program, the color conver- 
sion method comprising the steps of: 

20 

(a) downloading the color reproduction profile and the color reproduction program through a network 

(b) capturing a color reproduction characteristic of the color image dispiay means and a viewing iiiuminant con- 
dition by employing at least one of a color camera and a sensor; 

■(c) converting color of the color image obtained through the network using (i) at least one of the color conver- 
25 sion profile and the color conversion program, (ii) the color reproduction characteristic, and (iii) the viewing illu- 

minant condition; and 

(d) outputting the color image converted in said step (c) to the color image displaying means. 

27. A computer readable recording medium in which a program is recorded for making a computer execute a color 
30 reproduction method, the color reproduction method comprising the steps of: 

storing a color conversion profile and a color conversion program; and 

supplying the conversion profile and the conversion program to a color reproduction terminal apparatus 
through a network in response to a request from the color reproduction terminal, 
35 whereby the color reproduction terminal is enabled to perform color conversion using the conversion profile 

and the conversion program. 

28. A program for making a computer execute a color conversion method using at least one of a color conversion profile 
and a color conversion program, the color conversion profile and the color conversion program for being down- 

40 loaded through a network, the color conversion method comprising the steps of: 

(a) capturing a color reproduction characteristic of the color image display means and a viewing illuminant con- 
dition by employing at least one of a color camera and a sensor; 

fb) converting color of the color image obtained through the network using (i) at least one of the color conver- ^ 
45 sion profile and the color conversion program, (ii) the color reproduction characteristic, and (iii) the viewing illu- 

minant condition; and 

(c) outputting the color image converted in said step (b) to the color image displaying means. 

29. A program for making a computer execute a color reproduction method of a color reproduction server,. the color 
so reproduction method comprising the steps of: 

storing a color conversion profile and a color conversion program; and 

Supplying the conversion profile and the conversion program io a coior reproduction ierminai apparatus 
through a network in response to a request from the color reproduction terminal apparatus, 
55 whereby the color reproduction terminal apparatus is enabled to perform color conversion using the conversion 

profile and the conversion program. 
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